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My Background: I speak from experience as a participant in the regulatory peer review process, 
and not as an academic who has many publications in this Field. I have occasionally written 
reviews of such publications. (Examples: Graham and Hartwell, 1997 [1], Powell, 1999 (2]) A 
brief summary of my peer review participation is as follows: EPA SAB (many committees 
including CASAC), 1978-2000; NAS/NRC, about 15 committees. Nuclear Waste Technical 
Review Board 1989-94, California Prop 65 Science Advisory Panel, 1987-1989. (I also have 
some limited experience on funding peer review for NSF and three decades of involvement in 
journal peer review.) 


My Main Themes, which Emerge from the “Mis-Read” Book (National Research Council, 

1983). Guston (p. 7) uses the term “heuristic separation” between risk assessment and risk 
management to describe the recommendations of this NAS/NRC. As an author of this report, 1 \ 

will emphasize the original language of its lead recommendation, #1, p. 7,151: y r 


a 
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Regulatory agencies should take steps to establish and maintain a clear conceptual 
distinction between assessment of risks and the consideration of risk management 
alternatives; that is, the scientific findings and policy judgments embodied in risk 
assessments should be explicitly distinguished from the political, economic, and technical 
considerations that influence the design and choice of regulatory strategies. [Emphasis 
added.] 
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1 will also describe recommendation #2, which calls for a written risk assessment document, and 
Recommendation #3, which calls for a review by “an independent science advisory panel" prior 
to use of the risk assessment for regulatory decision making. I plan to spend a few sentences 
describing how the Red Book came to be misread by William Ruckelshaus and others as 
recommending separation of risk assessment and risk management, and I will (once again!) urge 
those interested to read the original version. 

What is regulatory peer review? I think it should address the question, “Is the science applicable 

to the regulatory decision clearly summarized and correctly interpreted, including disclosure of 

unc ertainties?” The peer review should be provided in the form of a writtenTfocument that is 
publicly available (from Rec. # 3 above, p. 156). 


I am willing to consider a broader definition, that peer review in a risk management context is 
like a medical “second opinion,” in which independent scientists from outside a government 
agency provide judgment and opinion regarding a conclusion or a recommended course of action. 
I think it is crucial that a scientific peer review be advisory in nature, rather than force the 
government agency’s decision. I like the language from the Supreme Court’s Daubert decision 
cited by Guston (p, 26) (hat the peer review should be “important, but not disposative.” I think 
that it is very dangerous and misleading when a group of scientists appointed to advise a 
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government agency are enabled to make policy in a way that masquerades as science. The 
message of the 1983 Red Book is that science and policy are very difficult to separate because of 
the uncertainties and the complexity of the scientific issues and the policy judgments required for 
regulatory decision making. Elected or appointed political leaders, and not their scientist advisors, 
should be accountable for regulatory decisions. So I also like Guston’s language (p. 26) that there 
should be “clear instructions for the threshold of decision making.” I interpret this statement to 
mean that peer review advisors should not make policy where policy for regulatory decision 
making is not clear. This idea was the motivation for the almost-forgotten main theme of the Mis- 
Read Book, the need for uniform but flexible risk assessment guidelines. (Rees #5-10, pp. 162- 
175.) The need for peer review in Red Book Rec U3 was not motivated by resolving ambiguity, 
but rather to assure that clearly defined procedures described in guidelines are followed in 
specific risk assessments supporting regulatory decisions. 

Supporting Stories from My Experience; Legal Protection Recommendation 

I plan to tell about the change in emplacement strategy for high-level nuclear waste at Yucca 
Mountain as an example of how an agency can follow advice from a peer review oversight group. 
1 plan to tell about the conflict and litigation on the “Authoritative Bodies” provision of 
California’s Proposition 65. 

This latter experience motivates my first recommendation, that scientists who serve on peer 
review panels should have legal protection of the same type as agency employees covering their 
actions as advisors to a regulatory agency. 

My Other Conclusions and Recommendations 

I believe peer review needs to be focused and realistic about the time available from scientific 
advisors who have other demands that take up most of their time. Review of agency risk 
assessment documents and other written work products or work plans can be highly productive 
without requiring extensive time from the peer reviewers. Broadly chartered efforts in strategic 
planning, formulating agency science policy, or setting research goals are types of efforts that in 
my judgment are usually best done by agency staff and/or contractors, who will work on such 
efforts full time and be held accountable for results and timeliness. 

I would like to see much more peer review of important regulatory agency work products, 
including both risk assessments and cost-benefit analysis/regulatory impact analysis, in which 
benefits are calculated from risk estimates of health effects or environmental damage avoided by 
regulation. (This is usually the same type of information used in risk assessments, and the two 
types of documents should match, including on the disclosure of important uncertainties!). 

Peer reviews should result in written documents. My experience with the EPA SAB and with 
NAS/NRC persuades me that FACA can be overly cumbersome. I prefer a peer review process 
in which information is gathered in public meetings where all interested parties have the 
opportunity to participate, followed by closed deliberation among the peer review committee in 
writing a report that becomes publicly available only when finished, Drafts and reviews of drafts 
of this peer review report should not become publicly available. Committee authorship is 
preferred to a collection of individually signed reports. 
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